The following report contains model performance metrics for the NY City Hourly Probabilistic Residential Energy Demand Forecasting Pipeline.
Model performance was evaluated on both long-term and day-ahead forecasts. Evaluation was conducted using a holdout dataset of hourly energy
demand values between 2023-08-05 and 2024-03-01.
Long-Term Forecasting Performance
The following table contains performance metrics for the forecasting model compared with a yearly moving average baseline model.
|
MSE |
Weighted MSE |
MAE |
MAPE |
Wilcoxon Test p-value |
| Forecasting Pipeline |
283636.10 |
243416.34 |
364.58 |
0.06 |
0.0 |
| Baseline Yearly MA |
1008851.94 |
1008851.94 |
762.95 |
0.14 |
NaN |
The following Plotly Figure helps to contextualize the forecasting model's performance by showing its predictions along with the actual energy demand
values. It also presents the 95% confidence interval bounds estimated by the forecasting model.
Day-Ahead Forecasting Performance
The following table contains performance metrics for the forecasting model compared with a yearly moving average baseline model.
|
MSE |
Weighted MSE |
MAE |
MAPE |
Wilcoxon Test p-value |
| Forecasting Pipeline |
TBD |
TBD |
TBD |
TBD |
TBD |
| EIA Forecasts |
141420.65 |
TBD |
311.91 |
0.06 |
NaN |
The following Plotly Figure helps to contextualize the forecasting model's performance by showing its predictions along with the actual energy demand
values. It also presents the 95% confidence interval bounds estimated by the forecasting model.
The following data has been made up for demonstration purposes. Actual data will be provided in a future update.